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Abstract: The human visual system can recover the 3-D shape of moving 
objects on the basis of motion information alone. Computational studies of 
this capacity have considered primarily non-planar rigid objects. With respect 
to moving planar surfaces, previous studies by Hay (1966), Tsai Sz Huang 
(1981), Longuet-Higgins (1984), have shown that the planar velocity field has 
in general a two- fold ambiguity: there are two different planes engaged in 
different motions that can induce the same velocity field. 

The current analysis extends the analysis of the planar velocity field 
in four directions: (l) the use of flow parameters of the type suggested by 
Koenderink & van Doom (1975), (2) the exclusion of confusable non-planar 
solutions, (3) a new proof and a new method for computing the 3-D motion 
and surface orientation (4) a comparison with the information available in 
orthographic velocity fields, which is important for determining the stability 
of the 3-D recovery process. 
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1 . Introduction 

When objects move in the environment with respect to the viewer, the 
images they cast upon the viewer's retina undergo complex transformations. 
The human visual system can interpret these transformations to recover the 
three-dimensional (3-D) structure of the viewed objects and their motion in 
space. 

A substantial number of computational studies have investigated this ca- 
pacity to recover structure from motion. The main two goals of these studies 
have been (i) to determine the conditions under which the 3-D structure can 
be recovered uniquely from the changing projection, and (ii) to develop meth- 
ods for computing the 3-D structure and motion in space from the projected 
transformations. 

With respect to the uniqueness problem, the main conclusion from these 
studies has been that for non-planar rigid objects in motion, the 3-D structure 
and motion are determined uniquely by the projected transformation. Results 
of this type have been established for both perspective and orthographic pro- 
jections, and for different forms of input to the recovery process, including 
discrete points in discrete views, discrete points and their velocities, and a 
continuous velocity field. 

The uniqueness results obtained in these studies depended criticially upon 
the object being non-planar. Until recently, the problem of interpreting the 
motion cast by planar surfaces has remained relatively unexplored. The prob- 
lem has obvious practical implications, since many surfaces are planar or 
nearly planar, and in these cases methods that assume non-planarity would 
be incorrect or unreliable. As mentioned by Waxman & Ullman (1983) and 
by Longuet-Higgins (1984), the analysis of motion relative to a planar surface 
may be relevant to certain situations of night-landing of an aircraft, where 
the main visual cues are roughly coplanar. 

Hay (1966) was apparently the first to analyze mathematically the visual 
interpretation of moving planes. Hay's analysis assumed that the visual input 
is given in the form of two discrete views obtained from a set of points in 
motion. 

The main result established by Hay was that the interpretation problem 
in this case exhibits in general a two-fold ambiguity. In addition to the moving 
plane that has actually cause the viewed transformation there is in general 
one additional "confusable" plane. The second solution is entirely different 
from the first in its spatial orientation and motion through space. 

Similar results have been established by Tsai &i Huang (1981), based on a 
different method of analysis. They have also shown that when the translation 



in space in along the normal to the surface, the ambiguity disappears and the 
solution becomes unique. 

A recent study by Longuet-Higgins (1984) has identified an additional 
condition under which the two-fold ambiguity disappears, lie also provided a 
different method of analysis and a different algorithm for computing the 3-D 
parameters. 

The current paper extends the analysis of the planar velocity field (i.e.. 
the velocity field induced by a moving planar surface) in four directions. First, 
it uses a different form of input to the recovery process. Instead of discrete 
points, it uses continuous flow parameters such as local vorticity, shear, and 
their derivatives. The use of flow parametsrs in the analysis of the optical 
velocity field was suggested originally by Koenderink &i van Doom (1975) 
and by Longuet-Higgins &; Prazdny (1980). An analysis based entirely on this 
form of input has been developed recetly by Waxman &; Ullman (1983). When 
this method was applied to planar surfaces, it was found empirically that 
there were in general two distinct 3-D solutions. The result was not proven 
mathematically, however, and the possible existence of additional solutions 
was not ruled out. 

An analysis based on input in the form of flow parameters is of interest for 
two reasons. First, as emphasized by Koendrink &; van Doom and by Longuet- 
Higgins<k Prazdny, the flow parameters are convenient in the sense that they 
usually have a clear geometric interpretation, and some of them are invariant 
with respect to the choice of a coordinate system. Second, in analogy with 
the non-planar case, it is of interest to examine the interpretation problem 
for different forms of input since the analysis of each case is usually different, 
leading to a different recovery method with somewhat different properties. 

The second direction in which the current paper extends previous inves- 
tigations is the consideration of confusable non-planar solutions. Previous 
studies have assumed that the moving surface is known to be planar, and ex- 
amined the number of possible planar solutions. It is of interest, however, to 
determine the ambiguity of the interpretation when the moving surface is not 
known in advance to be planar. It is shown here that confusable non-planar 
solutions can in general be ruled out. Third, the method of analysis is differ- 
ent from previous studies, leading to a different family of possible algorithms. 
Finally, the information available in the orthographic rather than perspec- 
tive velocity field of planar surfaces is analyzed. Since under local analysis 
perspective and orthorgraphic projections become almost indistinguishable, 
this analysis indicates some limits on the information that can be extracted 
reliably from a local analysis of the velocity field. 



2. The Velocity Field of a Moving Surface 

The analysis of I lie planar velocity field will proceed in two steps. In the 
first step the projected velocity field will be expressed in terms of the 3-D shape 
and motion parameters of the inducing surface. The descriptoin will follow 
the derivation in VYaxman i: Ullman (1983). This step is straightforward, 
and the resulting 2-D velocity field is obviously uniquely determined by the 
3-D parameters. The second step (Sections 3,4,5) consists of inverting this 
process: given the instantaneous flow field of a planar surface, the problem is 
to recover the unknown 3-D parameters. 

2.1 ^Notation 

Following Longuet-Higgins &c Prazdny we will use a coordinate system 
(X,Y,Z) moving with the observer relative to the scene. The origin of the 
coordinate system is the vertex of the perspective projection from the scene 
to the image, and the Z-axis is oriented along the instantaneous line of sight. 
The Z-axis intercepts the viewed object at (0,0, Z ). It is assumed that around 
this point the object can be described by a twice-differentiable surface (not 
necessarily planar) Z(X,Y). Image coordinates will be denoted by lower-case 
letters (x, y) where x = ^ , y = ^ . U,V,W will denote velocities in space in the 
X,Y,Z directions, and u, v image velocities in the x, y directions. Subscripts 
such as u x ,u y will denote partial derivatives along the x and y direction. 

2.2 The Instantaneous Velocity Field Around the Origin 

The instantaneous motion of a rigid object can be described by six inde- 
pendent parameters. We will denote them by M t ,i — 1,...6. Mi,M 2 ,M 3 are 
the velocities along the X, Y, Z directions scaled by the distance Z ,Mi = 
U/Z ,M 2 = V/Z ,Ms = W/Zq. M 4 ,M 5 ,M e are the angular velocities 
around the X,Y,Z axes. The shape parameters we will use are Ti,...,T$, 
the surface orientation at the origin T\ — (§j|) , ^2 = ("jy ) > an d the sur- 
face curvature at the origin (scaled byZ ) T s = Zo{§x^) , T 4 = Z (fy4 ) > 
T$ = ^o( d3;d v ) - Ti are assumed below to be finite. 

The image observables that will be used to recover the unknown 3- 
D shape and motion parameters are the image velocity at the origin (0,0) 
and its first and second derivatives in the x and y directions. Rather than 
using these derivatives themselves, we will use linear combinations of them, 
as suggested originally by Koenderink & van Doom (1975) and by Longuet- 
Higgins & Prazdny (1980). 



We will use a set of 12 image observables denoted by 0\. ...,0 12 . They 
are defined as follows. 
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The first two observables evaluated at (0,0) are the image velocity at the 
origin in the x and y directions. The next four can be thought of as describing 
the deformation of a differential neighborhood around the origin. 3 and 4 
are the rate-of-stretch along the x and y axes, O5 measures the rate of decrease 
in the angle between line elements oriented along the axes, and 0§ is the local 
rate of rotation. O7 — 0\ 2 are the spatial derivatives of these variables. By 
evaluating explicitly the various derivatives it is straightforward to obtain the 
mathematical relations between the observables 0\, ...,Oi2 and the unknown 
parameters Mi, ...,M 6 T\, ...T 5 (Waxman & Ullman 1983. See also a similar 
derivation in Longuet-Higgins & Prazdny 1980). The resulting equations are: 



O x = -Mj - M 5 

2 = -M 2 + M 4 

3 = M 3 + MiTi 

4 = M 3 + M 2 T 2 

5 = |(Af 2 T 1 + M 1 T 2 ) 

6 = -M 6 + \{M 2 T, - M X T 2 ) 



(1) 

7 = -2(M 5 + MsTj) + M 1 T 3 
Og = M 4 - M 3 T 2 + MiT?, 

9 = -M s - M 3 T X + M 2 T 5 

10 = 2{M 4 - M 3 T 2 ) + M 2 T 4 

On = \{-M 4 + M 3 T 2 + M 2 T 3 - M&) 
Q 12 = §(-M 5 - M 3 Tj - M X T 4 + M 2 T h ) 



These relations can be used for the recovery of the 3-D shape and motion 
parameters by solving for the M % and T % when the O t are given (measured 
in the image). Longuet-Higgins «fe Prazdny (1980) have shown that for non- 
planar patches a similar set of equations has at most three different solutions. 
It was found in computer simulations (Waxman &i Ullman 1983) that the 
solution is usually unique, but an analytic uniqueness proof is still lacking. 
We next turn to the planar case and show that eq. (1) then have in general 
exactly two distinct solutions. 

3. The two-fold ambiguity of planar surfaces 



In the planar case the surface curvature parameters T 3 ,T 4 ,T 5 in (1) 



all vanish. The resulting equations are still coupled and non-linear, and the 
number of distinct solutions is not immediately apparent. In this section it 
is shown thai there are in general two distinct solutions. In addition to the 
surface that gave rise to the velocity field there is in general one (and only 
one) additional surface, engaged in a different motion, that can produce an 
identical velocity field. 

3.1 There are in general at least two distinct solutions 

When T 3 — T 4 = T 5 = the last four equations in (1) are immediately 
derivable from the preceding eight and can be ignored. If the resulting system 
of eight equations has a solution, it also has a second solution, that is in general 
different from the first. This claim is established by giving explicitly a second 
solution in terms of the first. Let (Mi, ..., M 6 , T\, T 2 ) be a solution to (l) (with 
T 3 = T 4 = T h — 0). A second solution (Mi, ...M 6 ,Ti,T 2 ) can be derived 
explicitly as follows: 

Ti = -Mi /M a 

T\ = ~M 2 /M 3 

Mi = -T X M 3 

M 2 = -T 2 M 3 (2) 

M 3 = M 3 

M_4 = M 4 - M 2 - M3T2 

M 5 = M 5 + Mj + M 3 Tj 

M 6 = M 6 + MjT 2 - M 2 Ti 

This solution exists provided that M3 7^ 0. Ths case M 3 = is examined 
in section 4 below. The two solutions are dual in the sense that either one 
can be used in (2) to obtain the other. In the two solutions the directions of 
the translation vector and the surface normal are interchanged. If v, n are the 
translation vector and surface normal in the first solution, then the second v 
points in the direction of n, and n in the direction of v. 

We next turn to show that there are no more than two distinct solutions. 
This will be done in two stages. Section 3.2, which is the main step in the 
proof, shows that if two planar surfaces have identical velocity fields then 
they have the same value of M 3 (velocity along the line of sight). Section 3.3 
establishes that there are at most two solutions that share the same value of 
M 3 . 

3.2 Two planes that induce the same velocity field have the same value of Ms 



Let n and n be two planes engaged in motions (A/, A/< ; ) and (A/j ..... .W G ) 

respectively, that induce identical velocity fields (i.e.. identical observables 
in (1)). We can assume that the two planes intersect. Otherwise. T\ -- 

r 1.7*2 7V which implies either (i)(A/j Afr,)^ (M, . .... M ). or (ii) all 

of the translation components A/j . Af 2 . Si*. A/j . A/ 2 - M ?l , vanish. This latter 
case, corresponding to pure rotation, is uninteresting since no 3-D informa- 
tion is conveyed by the changing image. Let t be the intersection of tt and W. 
This special line in space participates in two different motions and induces the 
same (linear) velocity fields. Without loss of generality we can re-orient the 
coordinate system so that the projection of £ coincides with the x axis. The 
line £ can be described now by Z — ax 4- Zq. The main step in the proof is 
to consider the intersection line £ instead of the two planes. This line has the 
property that when it participates in motion (Mi,..., Me) or (Mi,..., Me), it 
induces identical velocity fields. 

Consider the situation in which the planes no longer exist, only the single 
line £ is moving in space. Let it move with the 3-D motion parameter (Mi — 
Mi, ...,Me - Me). From the original coincidence between the velocity fields 
of tt and tt, and since £ lies on both planes, it follows that the velocity field 
projected by £ now vanishes, i.e., it satisfies at the origin the equations: 

Ii = 0=0 (3) 

^ =o 

ox 

We have transformed the problem of the moving planes into a problem 
concerning a moving straight line. The question is: Under what conditions 
the velocity field of a moving line, as expressed in eq. (3), vanishes? In the 
re-oriented coordinate system let us denote 

M 1 ~M 1 = V x M 2 -M 2 = V y M s -M 3 = V z 
M 4 - M 4 = w x M 5 - M 5 = w y M 6 - M 6 = w z 

The five equations in (3) can be expressed in terms of the six motion pa- 
rameters (V x , V y ,V z , Wy, w z ). The derivation is somewhat lengthy, but straight- 
forward. The resulting equations are: 

V X + Z Q Wy = 

(4) 
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From which it follows that: 

\ , ~ \'z ir y — \' w - Z { )W X (iu\, - w z 

in term? of the original planes n . x, the implication of V^ — in that 
My, — A'/?.- In the particular coordinates system in which t projects onto the 
x-axis. it is also true that \l x — Mj and M 5 — M- n . 



Since all the possible planar solutions share the same value of M$, the 
proof will be completed by showing that for a given M3 there are at most 
two distinct solutions. We proceed along the following plan. If n is a planar 
solution let £ be now the intersection line of 7r with the frontal plane Z = Zq. 
We will call I the "tilt line" of n. If we re-orient the coordinate system so that I 
runs along the x-axis, then in the new coordinate system T\ — 0. From eq. (1), 
in this reoriented coordinate system O3 = M3. It can be observed from eq.(l) 
that, if we exclude solutions in which T\ = and Mj = simultaneously, 
the a fixed M3 and T\ — determine the solution uniquely. We will show 
that there are at most two orientations of the coordinate system for which 
O3 = M3. This will imply that (except for two special cases that will be 
examined separately) there are at most two distinct tile lines and therefore at 
most two distinct solutions. We will assume here M 3 7^ 0, the case M3 = 
is examined in section 4. It is convenient for the proof to assume that the 
velocity field satisfies initially O3 = 4 . This can be assumed without loss of 
generality, since it is always possible to satisfy the assumption by re-orienting 
the coordinate system (choosing new x, y coordinates) in the following manner. 
Let us rotate the coordinate system along the line of sight by an angle /? and 
denote the eight observables in the new coordiante system by (0\, ...,Og). 
We will determine an angle j3 such that following the rotation O s — O4. In 
the rotated coordinate system: 

3 = O z cos 2 l3 + 4 sin 2 l3 + 20 5 sin/3cosf3 

4 = 4 cos 2 /3 + O s sin 2 /3 - 20 5 sinj3cosp (5) 

to obtain O3 = O4, /3 must satisfy 

(0 3 - O 4 )cos2/? -f 20 b sin2/3 = 

assuming 0$ ^ O, f3 is determined by 

tan2p = ^^ (6) 



There will always be a solution for/?. (Not necessarily unique. The case 
Or, -■ will be examined separately.) We can assume therefore that we have 
initially a coordinate system in which ()••, - 4 . We now rotate the coordinate 
system by a new angle a. and denote again the observables before the rotation 
be (Oj. ....O^) and following the rotation by (O^ ...,O b ). We seek an angle a 
for which O s = M?,. In general 3 — 0- A cos 2 a J - 4 sin' 2 a -f- 20r,sj'n acos a. 
But since 3 _ Q 4 

O3 = 3 -f 20$sin acos a (7) 

assuming O5 ^ 



Of, 

There are four solutions for a in the range [0, 2jt], c*i, 02, c*i -f- 7r,a: 2 + 
7r. The solution a. l ,o.i + tt are equivalent, they give the same solution for 
(M 1 ,...,M 6 ,Ti,r 2 ). 

This establishes the claim for the general case. Two special cases that 
were excluded from the proof can be analyzed in a similar manner. In the 
first case there is a solution for which T\ = and M\ — simultaneously. In 
this case the velocity field will have a single direction along which O3 = M 3 . 
Mi, M3, M5, Ti are then determined uniquely, but there are two solutions for 
M 2 , M 4 , T 2 , in (1). In the second case 5 = for every orientation of the 
coordinate system. In this case there are two solutions, in one Ti = Ti — 
(frontal plane) and in the other Mi = Mi = (motion along the line of 
sight). In all of these cases the velocity field admits at most two planar 
interpretations. 

4. Unique Solutions 

In the previous section it was shown that the velocity field of a moving 
plane is compatible, in general, with exactly one additional moving plane. 

There are two special cases under which the two-fold ambiguity disap- 
pears, and a degenerate case under which the surface orientation cannot be 
recovered. The discussion of these cases will be brief, since one of these cases 
is discussed in Ullman &; Waxman (1983) and the other in Longuet-Higgins 
(1984). 

The degenerate case arises when Mi = M 2 = M 3 = 0. The motion in 
this case is pure rotation. The motion parameters can be recovered, but the 
surface orientation remains ambiguous. 

One unambiguous case arises when there is no relative velocity along the 
observer's line of sight, i.e. M 3 = (but Mi and M 2 are not both zero). In this 



rase llie motion equations can be solved explicitly, and the solution is unique. 
The second unambiguous case arises when A/ : - ; y and the observer moves 
directly towards or away from the surface 1 . If the original motion satisfies 
Mi M'A 1\ . M-> M* -- T-2 then it can be seen from equation (2) that the 

second solution coincides with the first. The latter condition is discussed in 
Longuet-Higgins. (1984). He also suggested an additional condition that can 
be used to resolve the ambiguity, by using an extended region of the plane 
rather than the local velocity field. 

In the previous section we have left out the case O5 = 0. Inspection 
of the equations reveal that this case falls into one of the categories already 
discussed. One case where O5 = is obtained when Mi = M 2 = M3 = 0, 
the ambiguous case discussed above. A second case is when Mi = Mi — 
(but Ms 7^ 0) and T\ — T 2 = 0. In this case the motion is along the surface 
normal, and the solution is unique. In all other cases there are two distinct 
solutions. 

4.1 Summary 

The ambiguous and non-ambiguous solution can be summarized as fol- 
lows. 

1. In the pure rotation case the motion can be recovered but the surface 
orientation remains ambiguous. 

2. If there is no relative velocity along the line of sight (M3 — but MiM 2 ^ 
0), or if the motion satisfied M1/M3 = -T\, M2/M2 = -T 2 (motion 
perpendicular to the plane), then the solution is unique. 

3. In all other cases the local velocity field has a two-fold ambiguity. The 
second solution can be derived in terms of the first by equation (2). 

5. The exclusion of non-planar solutions 

We have seen in the previous section that the velocity field of a moving 
plane has in general one additional planar interpretation. That is, if the 
moving surface is known to be a plane, there are in general two distinct 
solutions. The possibility remains, however, that when nothing is known in 
advance about the surface, there are additional non-planar interpretations. 
In this section the question of non-planar ambiguities is considered. In other 
words, the question is whether in addition to the two planar interpretations, 
non-planar solutions are also possible. 

Let 7r be a moving plane and let fi denote the vector (Mi, ...,M 6 ) of its 
motion parameters. Suppose that the twice-differentiable surface P is non- 
planar around the origin and that it induces the same velocity field as n, and 
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lei p denote the motion parameters of P. It is shown that if the velocity 
fields of P and x coincide in a neighborhood around the origin, then P is 
in fad planar at the origin. That is, if T 3 . T 4 , T 5 are the surface curvature 
parameters of P at the origin then T 3 -- T 4 = T r , = 0. 

Without loss of generality we can assume that both surfaces pass through 
the point (0,0, Z ). We can then distinguish between two cases. 

Case 1 : tt is tangent to P at (0,0. Zq). In this case n and P have the same 
values for Ti,T 2 . From the original equation (1) it can be verified that the 
only ambiguous configuration in this case is when Mi and M 2 in (1) both 
vanish. That is, the motion is directed along the line of sight. In all other 
cases P must coincide at the origin with ir, and satisfy T 3 = T 4 = T 5 — 0. 

Case 2: n intersects P along some space-curve c. Let 7 be the projection of c 
on the image plane. Assume first that near the origin 7 is not a straight line 
segments. Longuet-Higgins (1984) has shown that given the image velocities 
of four coplanar points (no three of which are colinear in the image), the 3-D 
motion parameter can be recovered up to the two-fold ambiguity discussed in 
the previous section. 

The implication is that the motion p coincides either with /x or with JL, 
the motion of the dual solution to /1. In either case we obtain that planar and 
non-planar surfaces with identical motion parameters produce an identical 
velocity field. From the original equation (1) it can be verified that the only 
ambiguous configuration in this case arises again when Mi = M 2 = 0. If M 3 
also vanishes, (the pure rotation case), the situation is inherently ambiguous, 
as discussed in the previous section. If M 3 ^ then n is in fact tangent to P, 
as in the previous case. 

The only remaining possibility is that near the origin 7 is a straight line 
segment. In this case we can use the results of section 3.2. Without loss of 
generality 7 can be assumed to lie along the x axis. Let M t ,Ti denote the 
motion and shape parameters of 7r,M t ,7\ of P. From 3.2, it follows that 
M 3 = M 3 ,M 1 = M 1 ,M 5 = M 5 . In addition Tj = f x and T 3 = T 3 since 
both are measured along c which is straight line in space common to n and 
P, and T 3 = since n is planar. T 4 ,T 5 can now be analyzed using eq. (1). 
The equality of the observable O s in (1) implies M 2 T 5 = M 2 T 5 , and since 
T 5 — 0, M 2 T 5 = 0. Similarly 9 and 12 together imply M\T A = 0, and 
also M1T4 = since ~M X = M x . If M x + 0, f 4 = 0. From O 10 together 
with O g it now follows that M1T5 = M x T b and therefore T 5 = 0. The case 
Mi = can be analyzed in a similar manner. 

The final conclusion is that T 3 = T 4 = T s = except for the case 
My = M 2 = (motion along the line of sight). 



II 

In conclusion, we can distinguish between two cases. If the relative mo- 
i ion happens to be along the hue of sight, then the local velocity field of a 
plane n is also compatible with any non-planar surface with the same rela- 
tive motion parameters, and whose tangent plane coincides with n. Unlike 
the planar two-fold ambiguity, this ambiguity is local, and can be resolved by 
inspecting a larger region of the plane. 

In the more general case, in which the motion component parallel to the 
image plane does not vanish, non-planar solutions can be ruled out, and the 
only remaining ambiguity is the two-fold planar ambiguity. 

6. Algorithm 

The proof in section 3 although not entirely constructive, leads to a possi- 
ble algorithm for computing the planar solutions. The method will be outlined 
briefly. A different algorithm has been suggested by Longuet-Higgins (1984). 

We begin by rotating the coordinate system by an angle 9 to obtain 
03 = 4 (where O, are the observables in the rotated coordinated system). 
From (6) we obtain 

tan29 



20, 



(Provided that 5 ^ 0). We can therefore obtain a solution (non unique) 
for sin6,cos0. It is a straightforward computation to then compute the ob- 
servables (Oi, ...,Og) (Waxman & Ullman, 1983). 

The planar motion equations (first eight equations in (l)) can be viewed 
as eight linear equations in 12 unknown: Mi, ..., Mq, and Xi,...,Xq, when 
Xi = MiT u X 2 = M 2 T 2 , A 3 = M X T 2 , A 4 = M 2 T U A 5 = M 3 T U A 6 = 
M$T 2 . The eight equations are linearly independent. Furthermore, they can 
be divided into four groups of two equations. 

[M s , Xi, X 2 ) appear only in equations (3,4). 
(Me, A3, X 4 ) appear only in (5,6). 
(Mi,M 5 ,A 5 ) appear only in (1,7). 
(M 2 ,M 4 ,A 6 )in(2,8). 

As a result, each set of unknowns can be solved up to a single scalar: 

(M 3 , X x , A 2 ) = (m s ,xi,x 2 ) + a{rns,xi,x 2 ) 
(M 6 , A 3 , A 4 ) = (m 6 ,x 3 ,i 4 ) + /?(m 6 ,x 3 ,z 4 ) (8) 
(Mi,M 5 , A 5 ) = (mi,m5,i 5 ) + 7(m 1 ,m 5 ,x 5 ) 
(M 2 ,M 4 ,A 6 ) = (m 2 ,m 4 ,x 6 ) + S(m 2 ,rh 4 ,x e ) 
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the m, .???,. Tt,x, (; — 1 6) are determined by solving sets of two equa- 
tions in three unknowns. The scalars aj3. -).b remain to be determined. Since 
3 () 4 . it follows from (1) that A/i7\ - A-/ 2 T 2 . i.e. A' x -- A' 2 , therefore 
a - ] -t- QT| - x-2 - ax 2 and hence a is determined. Two possible values for 
J.~;.t are obtained from the equations. 

A']A' 2 -.Y 3 A' 4 

M s Xj = M^s (9) 

M 3 X 2 = M 2 X 6 

respectively. Finally we choose a value for (a, (3, 7,6) to satisfy the fourth 
independent relation M2X1 = M1X4. There will be at least one such set 
of values for (a,/?, 7, 8), and at most two. When one solution is known, the 
second can be found immediately using equations (2). 

7. The orthographic velocity field 

Previous sections have established that the parameters of a moving plane 
can be determined up to the two-fold ambiguity from an arbitrarily small 
patch near the origin. When the viewed surface patch is small, perspective 
effects become small, and the recovery process may become unreliable. It 
therefore becomes of interest to analyze the case of orthographic projection 
where perspective effects play no role. (In orthographic projection a space 
point X, Y, Z, projects to an image point x = X, y = Y .) 

7.1 The orthographic velocity field of non-planar surfaces 

Let Si be a non-planar surface moving in space. For the orthographic case 
it can be assumed that Si is fixed at the origin (0,0, Zq) since the translation 
components are immediately recoverable. The rotation of S\ can always be 
decomposed into the sum of two components: a rotation with angular velocity 
w (assumed to be non-zero) about an axis lying somewhere in the frontal 
plane (^-rotation) and a component (^-rotation) about the line of sight Z 
with angular velocity 9. 

A second surface 5 2 is said to be a depth scaling of Si if: 

1. For every point (x, y, z) on Si, (x, y,kz) is a point on 5 2 for some constant 
k (Jfc^O). 

2. The rotations wi and w 2 are around the same axis, and u> 2 = ui\/k. 

3. $i = 62 

For non-planar surfaces the following proposition can be established. If 
Si is a possible rigid interpretation of a given orthographic velocity field, then 



5-2 is another possible interpretation if and only if it is obtained from S'x via 
depth scaling. 

Note that if 0\ - tf-> .; 0, then S } and S 2 have different instantaneous 
axes of rotation in space. The orthographic velocity field therefore does not 
determine uniquely the rotation axis in space. 

Since our concern here is primarily with planar surfaces, the proof will 
be omitted, it can be found in (Ullrnan 1983). 

7.2 The orthographic velocity field of planar surfaces 

In the planar case the twofold ambiguity of planar surfaces is combined 
with the inherent depth-scaling ambiguity of orthographic projection. As a 
result the orthographic projection of a planar surface admits two interpreta- 
tions, each defined up to depth scaling. 

For simplicity of the analysis we can assume that in the planar velocity 
field all the velocity vectors are parallel to the x axis. (If the inducing object's 
Z-rotation is 6, then by rotating the observed velocity field by -0 all the 
velocity vectors will become parallel. Their direction can be taken as the 
x-axis.) 

The velocity field u(x, y) v(x,y) now has the form: 

u(x, y) — ax + fly 

v{x,y) = (10) 

If (w x ,w y ,w z ) is the angular velocity vector of the rotating surface (as- 
sumed to be non-zero) then: 

w y z - w z y = ax + [3y 

w z x — w x z = (11) 

One solution to these equations arises when w z — 0. This implies w x = 
(if z is not identically zero), and z = ^(ai + (3y). This solution corresponds 
to a plane rotating about the vertical axis. 

If w z ^ then w x ^ also and z = ^x. This solution is also a plane, 
with a tilt line along the x axis. 

These two possible interpretations cannot be resolved on the basis of the 
instantaneous velocity field. How much additional information is required 
to guarantee a unique solution? For non-planar objects, it can be shown 
(Ullman 1983) that one additional view is sufficient to remove the depth- 
scaling ambiguity. For planar objects, the problem is open. 

The orthographic velocity field is thus inherently more ambiguous than 
the perspective one. Instead of two solutions there are two families of solu- 
tions, each determined up to depth scaling. 



14 

The additional ambiguity of the orthographic velocity field implies that 
under local analysis (i.e. using a small surface patch) the 3-D recovery process 
is not entirely stable. Aspects of 1 he 3-D structure that are invariant under 
depth scaling are expected to be more stable than others. For planar sur- 
faces these invariants include the orientation of the tilt line and the rotation 
component around the line of sight. Parameters that are not invariant under 
depth scaling such as surface slant are expected to be less robust. 

8. Summary 

1. The velocity field of a planar surface exhibits in general a two-fold am- 
biguity. In addition to the moving plane that has actually induced the 
viewed transformation there is one additional, and in general entirely 
different, planar solution. 

2. There are special cases in which the interpretation of the local velocity 
field becomes unique. These cases are (i) M3 = (but MiM 2 7^ 0), 
and (ii) motion directed towards or away from the surface. A degenerate 
case arises for pure rotation. In this case the motion parameters can be 
determined, but the 3-D structure remains undetermined. 

3. Additional non-planar solutions are in general excluded. The exception 
is the case of motion directed parallel to the surface normal. 

4. The two planar solutions can be computed from the eight kinematic ob- 
servables, using the algorithm in section 6. 

5. If one of the two planar solutions is known, the dual solution can be 
expressed in terms of the first using eq. 2. 

6. In the orthographic case there are, instead of two solutions, two families 
of solutions, each determined up to depth-scaling. It is expected that 
for the perspective case only 3-D parameters that are invariant under 
depth-scaling would be robust under local analysis. 

The results explored in this paper are theoretical in nature. They set 
some limits on the performance of any motion perceiving device. It is un- 
known, however, to what degree the human visual system can approach these 
theoretical limits. It may be of interest, therefore, to test psychophysical^ 
some of the implications of the above analysis. For example: 

— Can subjects interpret the velocity field of planar surfaces? (i.e., make 
some reliable judgements of relative motion parameters and surface orienta- 
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tion). Results in (Gibson cl. al. 1959) indicate (hat under some condition 
tins is possible, although the accuracy is probably not very high. 

Can the) interpri'1, at least to some degree, the planar velocity fields 
under brief presentation 9 If t hey do. how do they handle the inherent twofold 
ambiguity? 

Can observers interpret orthographic velocity fields? Can they recover, 
for example, the tilt of one or both planar solutions? 

Answers to these questions may give us a better insight into the process- 
ing employed by the human visual system in the recovery of structure from 
motion. 
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